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Abstract. This paper provides a geometrical derivation of the Hybrid Minimum Principle 
(HMP) for autonomous hybrid systems whose state manifolds constitute Lie groups (G,*) which 
are left invariant under the controlled dynamics of the system, and whose switching manifolds are 
defined as smooth embedded time invariant submanifolds of G. The analysis is expressed in terms 
of extremal (i.e. optimal) trajectories on the cotangent bundle of the state manifold G. The Hybrid 
Maximum Principle (HMP) algorithm introduced in 1261 is extended to the so-called Exponential 
Gradient algorithm. The convergence analysis for the algorithm is based upon the LaSalle Invarianee 
Principle and simulation results illustrate their efficacy. 
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1. Introduction. Lie groups iiave been considered as configuration manifolds 
for many dynamical systems, see [T1l2]l6ll9| . Many control problems, mostly mechanical 
systems, have been addressed as control systems defined on Lie groups, see [TH[2T|. 
This class of control systems also includes optimal control problems on Lie groups, see 
[71|10II18II19| . The problem of hybrid systems optimal control (HSOC) has been studied 
and analyzed in many papers, sec e.g. |8t il5..23..26..27..30..33] . In particular, [4 „26.,27] 
present an extension of the Hybrid Maximum Principle (HMP) for hybrid systems 
and [26j presents an iterative algorithm which is based upon the HMP necessary 
conditions for optimality. The HMP algorithm presented in |26| is a general search 
method applicable to both autonomous and controlled hybrid systems. A geometric 
version of the Pontryagin's Maximum Principle for a general class of state manifolds 
is given in [2l[5l|27|. 

In this paper, we generalize the analysis in [26] and [29j to obtaine the HMP 
statement for left invariant hybrid systems defined on Lie groups. The proof given here 
can also be applied to right invariant hybrid systems where the corresponding adjoint 
variable will be different. This proof can be generalized to a class of autonomous 
hybrid systems associated with time varying switching manifolds. 

In the last part of the paper, specifically the HMP algorithm in [26] is generalized 
to the so-called exponential gradient HMP algorithm by employing the notion of ex- 
ponential curves on Lie groups. The convergence analysis for the proposed algorithm 
is based on the LaSallc Invarianee Principle. 

2. Hybrid systems. In the following definition the standard hybrid systems 
framework (see e.g. [SldS]) is generalized to the case where the continuous state space 
is a smooth manifold, where henceforth in this paper smooth means C°°. 

Definition 2.1. A hybrid system with autonomous discrete transitions is a five- 
tuple 

(2.1) n:= {H= Qx M,U,F,S,J} 

where: 

Q = {1, 2, 3, |Q|} is a finite set of discrete (valued) states (components) and A4 is 
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a smooth n dimensional Riemannian continuous (valued) state (component) manifold 

with associated metric gj^. 

H is called the hybrid state space o/H. 

U C R" is a set of admissible input control values, where U is a compact set in R". 
The set of admissible input control functions is I := {Loo[toitf),U), the set of all 
bounded measurable functions on some interval [to,tf),tf < oo, taking values in U. 
F is an indexed collection of smooth, i.e. C°° , vector fields {fqi}qi<^Q, where fq. : 
M X U ^ TA4 is a controlled vector field assigned to each discrete state; hence each 
fq- is continuous on Ai x U and continuously differentiable on M. for all u £ U . 
S :— {n^ : J G Q X Q,l < k < K < oo,n^ C Ai} is a collection of embedded time 
independent pairwise disjoint switching manifolds {except in the case where 7 = {p,q) 
is identified with 7 = {q,p)) such that for any ordered pair 7 = (p,q),n^ is an open 
smooth, oriented codimension 1 submanifold of A4 , possibly with boundary dn'^ . By 
abuse of notation, we describe the manifolds locally by n!^ = {x : n^{x) = 0, 2; G R"}. 
J shall denote the family of the state jump functions on the manifold A4. For an 
autonomous switching event from p € Q to q G Q , the corresponding jump function 
is given by a smooth map C,p q : A4 ^ A4: if x{t^) G S the state trajectory jumps to 
x{t) = C,p q{x{t~)) G Cp,q G J. The non-jump special case is given by x{t) = x{t~). 
We use the term impulsive hybrid systems for those hybrid systems where the contin- 
uous part of the state trajectory may have discontinuous transitions (i.e. jump) at 
controlled or autonomous discrete state switching times. 
We assume: 

Al : The initial state ho := (a;(to), qa) (z H is such that xq = a;(to) ^ S for aU qi G Q. 

A (hybrid) input function u is defined on a half open interval [tQ,tf),tf < 00, 
where further u G X. A (hybrid) state trajectory with initial state hg and (hybrid) 
input function m is a triple (r, q, x) consisting of a strictly increasing sequence of 
times (boundary and switching times) r = (to,ti,t2, ■ ■ .), an associated sequence of 
discrete states q = {qo,qi,q2, . . .), and a sequence x{-) = (x<j(, (•), (•), (•),.. .) of 
absolutely continuous functions Xq- : [ti,ti^i) — > Ai satisfying the continuous and 
discrete dynamics given by the following definition. 

Definition 2.2. The continuous dynamics of a hybrid system H with initial 
condition h^ = {xo,qo), input control function u E I and hybrid state trajectory 
(r, q, x) are specified piecewise in time via the mappings 

(2.2) {xq^,u) : [ti,ti+i) ^ M X U, i^O,...,L, < i < 00, 
where Xq-{.) is an integral curve of fq^{.,u{.)) : M x [^^,^^+1) — > TAi satisfying 

iqiit) = Iqi{^q,{i)^u{t)), Q.C. t G [ti,ti+l), 

where Xq.^-^{ti^i) is given recursively by 

(2.3) Xq^^,{U+i) = lim C«,.9,+i(2;«,(i)), h^ = {qQ,xo),t < tf. 

The discrete autonomous switching dynamics are defined as follows: 
For all p, q, whenever an admissible hybrid system trajectory governed by the con- 
trolled vector field fp meets any given switching manifold Up^q transver sally, i.e. 
fp{x{tj),tj) ^ T^f^^--^S, there is an autonomous switching to the controlled vector 
field fq, equivalently, discrete state transition p — > g, p,q E Q. Conversely, any 
autonomous discrete state transition corresponds to a transversal intersection. 
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A system trajectory is not continued after a non-transversal intersection with a 
switching manifold. Given the definitions and assumptions above, standard arguments 
give the existence and uniqueness of a hybrid state trajectory (r, q, x), with initial state 
Hq €z H and input function u G I, up to T, defined to be the least of an explosion time 
or an instant of non-transversal intersection with a switching manifold. 

We adopt: 

A2: (Controllability) For any q € Q, all pairs of states {xi,X2) are mutually 
accessible in any given time period [t,t] C [to,tf], via the controlled vector field 

iqit) = fq{Xq{t),u{t)), for SOmC U el ^ {Loc[to,tf],U). 

A3: {/q; gQ, is a family of loss /unctions such that ^g. G C'^{Aix U;R+),k > 1, 
and ft, is a terminal cost function such that h G C''{Ai; JR+), fc > 1. 

Henceforth, Hypotheses A1-A3 will be in force unless otherwise stated. Let L 
be the number of switchings and u £ I then we define the hybrid cost function as 

J{to,tf,ha;L,u) -.= 22 / >'qiixqAs),u{s))ds h{xq^{tf)), 

^=0 ■'t' 

(2.4) tL+i^tf <T,uel, 

where we observe the conditions above yield J(toi tf^ ^o; u) < oo. 

Definition 2.3. For a hybrid system H, given the data {to,tf,ho;L), the Bolza 
Hybrid Optimal Control Problem (BHOCP) is defined as the infimization of the hybrid 
cost function J {to, tf,ho;L,u) over the hybrid input functions u € I, i.e. 

(2.5) J°{to,tf,ho;L) =infu(iiJ{to,tf,h(3\L,u). 



Definition 2.4. A Mayer Hybrid Optimal Control Problem (MHOCP) is defined 
as the special case of the BHOCP where the cost function given in \2.4^ is evaluated 
only on the terminal state of the system, i.e. Iq. =0, i = 1, ...,L. 

In general, different control inputs result in different sequences of discrete states 
of different cardinality. However, in this paper, we shall restrict the infimization to 
be over the class of control functions, generically denoted U Cl, which generates an 
a priori given sequence of discrete transition events. 

We adopt the following standard notation and terminology, see [12] . The time depen- 
dent fiow associated to a differentiable time independent vector field fq. is a map 3> /u 
satisfying {fq.{.) is used here for brevity instead of fq.{.,u{t)) since the calculations 
are performed with respect to a given control u): 

: [t^,t,+i) X [t,,t,+i) xM^M, {t,s,x) ^^'^*f\x) := ((t, s), x) e M, 

(2.6) 
where 

(2.7) -.M^M, 'i>^ff\x) = X, 
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dt 



We associate T^^h'^\.) to ^f*^"' : — ^ via the push- forward of ^^ff\ 



(2.9) 



Following 



the corresponding tangent lift of (■) is the time dependent vector 



field /q^'"(.) € TTM on TTW 



(2.10) f:,rM 

which is given locally as 



r$^.?^(z;,), v,(.T,M, 



(2.11) 



9 9P'' . a 



-I *>i=i 



and r$iu*''(.) is evaluated on Vx G TjjAl, see [12]. The following lemma gives the 

relation between the push-forward of 'fj and the tangent lift introduced in ()2.1ip . 
For simplicity and uniformity of notation, we use /g. instead of . 

Lemma 2.5 ( [5], [29]). Consider fq(x,u) as a time dependent vector field on M 
and 'I'y* as the corresponding flow. The flow of f^'" , denoted by : I x I x TM — >■ 
TM, I — [to,tf], satisfies 

^{t,s,{x,v)) = ($yj''(x),T$5.*'"'(w)) e TM,{x,v) e TM. 

For a general Riemannian manifold M, the role of the adjoint process A is played by a 
trajectory in the cotangent bundle of A^, i.e. X{t) £ T*^^s^M. Similar to the definition 
of the tangent lift we define the cotangent lift which corresponds to the variation of a 
differential form a G T*M along x{t), see [31]: 



(2.12) 



/,'■■■"(«.) := f^\t=sT:<^>^;f'\ax), a, £ T^M, 
where here x — x{t) = <^^h^\x{s)) . 

■f q 

Similar to p. lip in the local coordinates {x,p) oiT*M, we have 



(2.13) 



d 



df^ 



d 



^^^^^""^dx^ ^ dxi 



The mapping T* is the pull back defined on the differential forms on the cotangent 
bundle of M. The covector ax is an element of T*A^, see [3T]. The following lemma 
gives the connection between the cotangent lift defined in (|2.12l) and its corresponding 
flow on T*M. 

Lemma 2.6 ( [S], |29|). Consider fq(x(t),u{t)) as a time dependent vector field 
on M, then the flow T : I x I x T*M T*M, satisfies (I = [to,tf]) 



(2.14) 



r(t,., {x,p)) = {>fl^\x),{T:^f;Y\p))A^,P) 6 T*M 
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and r is the corresponding integral flow of '". The mapping (T*$y.*'*') ^ = 

T;$^~*'"^) is defined as a pull back of $ ^ which its existence is guaranteed since 
<f> : — > is a difFeomorphism, see [5]. For a given trajectory X{t) G T*J^, its 
variation with respect to time, X{t), is an element of TT*M.. The vector field defined 
in (Pl^ is the mapping /J*'" : T*M TT*M, from X{t) G T*M to X(t) G TT*M. 

Proposition 2.7 ( [5], [H]). Let fq{.,u) : I x M ^ M be the time dependent 
vector field giving rise to the associated pair /J'", /J then along an integral curve 
of fq{-,u) on M 

(2.15) (r,«'):/^R, 

is a constant map, where T is an integral curve of f'^ in T*Ai and is an integral 
curve of /J''" in TA4 . 



Elementary Control and Tangent Perturbations. 

Consider the nominal control u{.) and define the perturbed control as follows: 



(2.16) u^(ji,„^)(i,e) := u^(t,e) 



ui t^ -e <t <t^ 
u{t) elsewhere 



where ui e U,0 < e. 

Associated to U7r(.) we have the corresponding state trajectory XTr{t, e) on A4. It 
may be shown that under suitable hypotheses of the differentiability of x^^ with respect 
to e at the switching times, then limej^o a;7r(^, e) — x{t) uniformly for tg < t < tf, 
see [ISI and [5D]. However in this paper we employ the same hypotheses of the 
differentiability of x^^ before and after switching times but must accommodate the 
fact that there may be a discontinuity of "^^jj*^ |e=o at any switching time ti. The flow 
resulting from the perturbed control is defined by: 

$t*/,^'"(e) : [0, t] -^M, xEM,t,se [to,tf],T G E+, 

(2.17) 

where 3>||.* j'''^(.) is the flow corresponding to the perturbed control u^(i, e), i.e. $^*'^'''^(e) 
$^*^^'((^) (x(s)). The following lemma gives the formula of the variation of 

fq ' ^ 

at e = 0+. Recall that the point t^ G {to,tf) is called Lebesgue point of u{.) if, ( [5]): 

(2.18) lim -/ \u(t) -u(t^)\dT = 0. 

For a li G Loo([io, ^/], C^), may be modified on a set of measure zero so that all 
points are Lebesgue and the value function is unchanged (see [H], page 158). 

Lemma 2.8 ( 0). For a Lebesgue time t^ , the curve <J>|^* ^^''^(e) : [0,t] M is 
differentiable at e ^ and the corresponding tangent vector ^$|^*y'*'''^|e=o given by 

(2.19) = /,(x(ti),«i) - f,{x{t^),u{t^)) G T.(ii)A^. 
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The tangent vector fq{x{t^), Ui) — fq{x{t^), u{t^)) is called the elementary pertur- 
bation vector associated to the perturbed control at {x{t),t). The displacement of 
the tangent vectors at 2; S is by the push- forward defined on the vector field fq. 

Proposition 2.9 ( [5]). Let \I> : [t^,tf] TM he the integral curve of fq'^ with 
the initial condition ^{t^) = [fq{x{t^),ui) ~ fq{x{t^),u{t^))] 6 T^(^ii-jAi, then 

(2.20) |ci,(*j^^)^-|^^„ = vl.(i), te[t\tf]. 

By the result above and Lemma 12.51 we have 

(2-21)|-</?'^le=o,.WeA. = T'i>'^;f \[fq{x{t'),u^) - fq{xit'),u{t'm e r.(,l)^. 



3. Control Systems on Lie Groups. In this section we introduce control 
systems on Lie groups and then extend the definition of hybrid systems above to that 
of hybrid systems defined on Lie groups. 

3.1. Lie Groups and Lie Algebras. Definition 3.1. A group (G,*) is called 
a Lie Group if, (see fS^): 

(1) : G is a smooth manifold, 

(2) : The group operations are smooth. 

(The group operations are multiplication and inversion, \fgi,g2,g S G, .91*32 G 
G,g~^ S G such that multiplication is associative and an identity and inverses exist.). 
In this paper it is assumed that the continuous part of the hybrid system evolves on 
a Lie group G. 

Definition 3.2. A Lie Algebra V is a real vector space endowed with a bilinear 
operation [., .] : V x V ^ V such that (see jlEUSEf ): 

(1) :yCv^v, [C,v]^-hC] 

(2) :[C, [7?, 7]] + [v, [7, C]] + [7, [C, ^]] = C, 7 e F 

The Lie algebra £ of a Lie group G is the tangent space at the identity element 
e with the associated Lie bracket defined on the tangent space of G, i.e. C = T^G. A 
vector field A on G is called left invariant if 

(3.1) V5i,52eG, X{gi^g2)=TLq,X{g2), 

where Lg : G ^ G, Lg{h) ^ g -k h, TLg : Tg^G — )■ Tg^^g^G which immediately imply 
X{g*e)^Xig)^TLgX{e). 

Definition 3.3. Corresponding to a left invariant vector field X , we define the 
exponential map as follows: 

(3.2) exp-.C^G, e.Tp(tA(e)) $(t,A),t G R, 

where $(t, A) is the solution of g{t) ~ X{g{t)) with the boundary condition g(0) = 
e. The following theorem gives the flow of a left invariant vector field with an arbitrary 
initial state g £ G. 
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Theorem 3.4 ( [32j). Let G be a Lie group with the corresponding Lie algebra 
C, then for a left invariant vector field X 

(3.3) ^{t,X,g) = Lgoexp{tX{e)), 
where '^{t,X,g) is the flow of X starting at g £ G. 

A left invariant control system defined on a given Lie group G is defined as follows: 
(see [UmilBI) 

(3.4) 9it) = fi9it),u) = TLg^t)fie,u), g(i) e G, u G R", 

where f{g{t),u) is a left invariant vector field on G. Similar to left invariant systems, 
right invariant systems are defined. In this paper we only consider hybrid systems 
where the associated vector fields are left invariant, however the analysis can also be 
applied to right invariant hybrid systems. 

3.2. Left Invariant Optimal Control Systems. A Bolza left invariant opti- 
mal control problem is an optimal control problem where 

(i) : the ambient state manifold is a Lie group G, 

(ii) : the corresponding vector field fq is a left invariant vector field defined on G such 
that for any given u (^lA 

(3.5) /,(.,«(.)) :Gx [to, t/]^TG, 
and 

(iii) : the cost ftmction is defined by 

(3.6) J .= lq{g{s),u{s))ds, uGU, 

J to 

where ^g((7(s), it(s)) is assumed to be left invariant i.e. lq{Liig(s),u{s)) — lq{g{s),u{s)). 
In general, a Bolza problem can be converted to a Mayer problem using an auxiliary 
state variable in the dynamics, see [26] and [S]. The following lemma gives the equiv- 
alence of a Bolza problem defined on a Lie group G and its Mayer extension. 

Lemma 3.5. Consider a left invariant Optimal Control Problem (OCP) defined 
on a Lie group G with the following dynamics and cost function: 

(3.7) g{t)^ f{9{t).u). g(t) 6G,7ieR", 

(3.8) J= f ' l{g{s),u{s))ds. 

Jto 

Then the Mayer problem associated to the optimal control problem above is defined on 
the Lie group G x K, and the corresponding dynamics are left invariant. 

Proof. The state space equation of the Mayer problem corresponding to the Bolza 
problem is as follows: 

(^■») (f)=(f,^,t:w))^^«<'''"'- 

where g = {g,z), g e G, z E M.. The group action defined on G x R is given as 
follows: 



(3.10) 



{9i,zi)*{92,Z2) = {gi-kg2,zi +^2), 
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where ★ corresponds to the group action of G and * is the group action of G x R. 
Since G is a Lie group it fohows that (G x R, ★) is also a Lie group. It remains to 
show that F{g,u) is left invariant. The left translation on G x R is defined by 

(3.11) Lg(h) = {Lgh,Zg + Zh), g = {g,Zg),h = {h,Zh), 

therefore 

TLgF(h, u) = TLgf{h, u) ® l{Lgh, u) = f{g * h,u) ® l{gi^ h,u) = F{g *h,u), 
(3.12) 

which shows that F{g,u) is left invariant since f{g,u) and l{g,u) respectively are left 
invariant. □ 

4. The Pontryagin Minimum Principle on Lie Groups. Optimal control 
problems on Lie groups have been addressed in [51[Tnj[IHl[Tl] . In this section we re- 
view the Minimum Principle results presented in |19) for optimal control problems 
defined on a Lie group G. As shown in |18| , the left translation gives an isomorphism 
between TG and G x C. Since Lg^i maps g to e, TLg-i : TgG T^G = C is the cor- 
responding isomorphism. This statement also holds between T*G and G x C* where 
C* is the dual space of the Lie algebra C. The corresponding isomorphism is given 
by T*Lg ■.T*G^ T*G = C* . We use the equivalence T*G ^ G x C* associated to 
the isomorphism above to construct Hamiltonian functions on Lie groups. 

Hamiltonian Systems on T*A4 and T*G. 
By definition, for an optimal control problem defined on an n dimensional differ- 
entiable manifold M., a Hamiltonian function is defined as a smooth function H : 
T*M x f/ — >■ R, see [51[TB]. The associated Hamiltonian vector field it is defined as 
follows (see [2]): 

(4.1) uJx{.,^) = dH, \eT*M, 

where u)x is the symplectic form defined on T* M. which is locally written as follows: 

n 

(4.2) LOx^^dQ Adxi, 

i=l 

and (C,2;) is the local coordinate representation of A in T*M.. 
The Hamiltonian system of the ODE corresponding to H is 

(4.3) A = i?(A), 
where locally we have 

(4.4) 

Similar to the case of Hamiltonian systems on smooth manifolds we can define 
Hamiltonian functions for left invariant vector fields on the cotangent bundle of a Lie 
group G. This is done by using the isomorphism between C* xG and T*G introduced 
above which is denoted by X: 

(4.5) (1) I{X,g)eT*G, XeC*,gGG, 
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(4.6) (2) I{-,g) '■= Ig '■= T*Lg-i : C* — > TgG is a linear isomorphism. 
A Hamiltonian function for a left invariant vector field X on G is defined by 

(4.7) Hx{g,\):^{X,X{e)) = {X,TLg-.X{g)), A £ £*. 

The preceding identification uses TT*G ~ T{G x £*) = (G x £) x (£* x £*), therefore 
the tangent vector at {g, X) E G x C* is an element oi C x C* denoted by T = {X, 7). 
The symplectic form lj along a given curve T{t) G T*G satisfies the following equation, 
see [2l[18]: 

c.r(Ti(r),r2(r)) = (72(t),Xi(i)) - {li{t),X2{t)) - (A(t), [x,{t),X2m, 
(4.8) 

where Ti = {Xi, 7^). Similar to Hamiltonian systems on T*A4, the Hamiltonian vector 
field li on G X C* satisfies the following equation 

(4.9) dH = LOri^t){.,t). 

The following theorem gives the Minimum Principle for optimal control problems 
defined on Lie groups. 

Theorem 4.1 ( |18j). For a left invariant optimal control problem defined by 
i3.5\) and i3.6\) . along the optimal state and optimal control g" (t) , u° (t) , there exists 
a nontrivial adjoint curve X°(t) g £* such that the following equations hold: 

(4.10) H{g°{t),X''{t),u°{t)) < H{g''{t),X''{t),u), Vu e U, 
and locally 

d\° 

(4.12) (A°(i)), 

dt ^ 

where H{g,X,u) := {X,TLg~i f{g,u)) . 

For each r]^ E C we have the following definition 

(4.13) adc^ : C ^ C, ad^rj ~ [CiV]- 
For each C,,r] E C,'-f C* , ad* is defined by 

(4.14) (ad^(7),r,) := (7,adc(r/)). 

For more information about the definition above see [UEl]. It should be noted that, 
in general, i.e. not necessarily left invariant vector fields, for a Hamiltonian function 
defined on G x £*, the integral curve of the Hamiltonian vector field, i.e. (|4.11l) and 
(|4.12p . satisfies the following equations (see jl8|): 



(4-15) l^TLg^,) 



J\ n TT 

(4.16) _ = _T*L,(,)(— )-(ad)|^(A(t)). 

Since the tangent space of T*G is identified with C x C* , by the definition of the 
Hamihonian iJ : G x £* ^ R, it is noted that || e £*' = £ and || e T*G. 



10 



Farzin Taringoo, Peter Caines 



5. Hybrid Systems on Lie Groups. The definition of hybrid systems on Lie 
groups is the specialization of that of hybrid systems given in Definition 12 . 1 1 where the 
ambient manifold A4 is replaced by a Lie group G. Here we only consider a hybrid 
system consisting of two different discrete states with the associated left invariant 
vector fields /^g, fq-^, as follows: 

(5.1) m = fMt),u{t)), g{t) = fq,{g{i).u{t)), u{t) eU. 

The switching manifold S associated to the autonomous discrete state change is con- 
sidered to be a submanifold of G which is by definition a regular Lie subgroup. The 
hybrid cost function is defined by 

1 rti+i 

(5.2) J = Y. k,(9q.A^)Ms))ds + h{gq^{tf)),u^U, 

where = 0, 1 are left invariant smooth functions on G. Similar to the proof in 
we apply the needle control variation in two different steps. First, the control needle 
variation is applied after the optimal switching time so there is no state propagation 
along the state trajectory through the switching manifold. Second, the control needle 
variation is applied before the optimal switching time. In this case there exists a state 
variation propagation through the switching manifold, see [55], 

Recalling assumption A 2 in the Bolza problem and assuming the existence of 
optimal controls for each pair of given switching state and switching time, let us 
define a function v : G x {tQ,tf) ^ R ior a hybrid system with one autonomous 
switching, i.e. L = 1, as follows: 

(5.3) v{g,t) = infueuJ{to,tf,ho,u), 
where 

9^'fl/"\9o)eScG. 

5.1. Non-Interior Optimal Switching States. In general the hybrid value 
function for a Mayer type problem attains its minimum on the boundary of the at- 
tainable switching states on the switching manifold and hence is not differentiable. 
In this case the discontinuity of the adjoint process in the HMP statement is given in 
terms of a normal vector at the switching time on the switching manifold. In order 
to have a normal vector N on the switching manifold we need to define a Riemannian 
metric on G. A left invariant Riemannian metric G on (G, ★) satisfies the following 
equation. 

(5.4) G{9){X,Y) = G{h^g){TLn{X),TLh{Y)), 

where X,Y € TgG. Let us consider I as an inner product in C where I : £ x £ — >• R. 
the following theorem gives a Riemannian metric with respect to an inner product I 
defined on C. 

Lemma 5.1 ( |12|). The inner product I on C determines a smooth left invariant 
Riemannian metric G on G as follows: 



(5.5) 



G{g){X,Y) := 7(TL<,-iX, Tig-iF), 
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where X,Y eTgG. 

A normal vector N at the switching state 5 (is) on S satisfies 

(5.6) G{g){N,Y)^Q, VY e T^^t^^S c Tg^t^~,G, 

where by Lemma [5TT] we have I{TLg-iN,TLg-iY) = 0. By the linear property of the 
inner product I on the vector space C, we can defined the following one form 

(5.7) DgN:C^R, DgN := I{TLg-iN, .) e C* . 

The following lemma shows that the one form Gg{N,.) is the puUback of DgN = 
l{TLg-iN, .) under the map T*Lg-i. 

Lemma 5.2. For a Lie group (G,*) associated with an inner product I on C we 
have 

(5.8) V.geG, G{g){N,.)=T*Lg-iDgN eT;G, 

Proof. We show that for all X g TgG, G{g){N,X) = {T* Lg-iDgN , X) . Obvi- 
ously TLg^i : TgG —i' C, therefore 

(5.9) {T*Lg-^DgN,X) = {T*Lg-^I{TLg-^N,.),X), 
By the definition of puUbacks, see [20], we have 

{T*Lg-iI{TLg-iN,.),X) = {I{TLg-iN,.),TLg-iX) = I{TLg-iN,TLg-iX) = 

(5.10) Gig){N,X), 

where the second equality comes from the definition of I. □ 

The following theorem gives the HMP statement for hybrid systems defined on 
Lie groups in the case of non-differentiability in all directions of the value function. 
It is the main result of this section and will be established by a sequence of lemmas. 

Theorem 5.3. 

Consider a hybrid system satisfying the hypotheses Al, A2, A3 on a Lie group 
G and an embedded switching submanifold S C G with an associated inner product 
J : £ X £ — > R. Then corresponding to an optimal control and optimal trajectory 
{u° (t) , g° (t)) for a given MHOCP, there exists a nontrivial X° G C* along the optimal 
state trajectory such that: 

(5.11) i/,,(.g°(t),A°(t),ii°(t)) < ff,,(.g°(t),A°(t),iii),Viii eU,te [to,t/],i - 0,1, 
and at the optimal switching state and switching time {g°{ts),ts) we have 

(5.12) A°(t;) = A°(t,) + M/(TL^o-i(,^)iV,.) e C*. 
and the continuity of the Hamiltonian is satisfied as follows 

(5.13) i/,„(g°(t;),A°(t:),u°(t7)) = if,,(g°(t,),A°(t,),^°(t,)). 
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The optimal adjoint variable X° satisfies 

(5.14) -j-=TL,.^t){^), — = -(ad)*a^(A°(t)),tG[t„i.+i),g. eg, 
where 

(5.15) H,A9,X,u) := {X,TLg-i f,^{g,u)). 

It should be noted that in the case which the normal vector is not uniquely given, 
the discontinuity of the adjoint process is given by 

(5.16) x°{t-) - A°(t,0) e r*V(,^,)(r;„-;^_^5), 

where 

(5.17) T*^S := {q e r*G, s.t. VX e TgS, {a,X) = 0}. 



In order to prove Theorem 15.31 we employ the notion of control needle variation 
which has been widely used in the optimal control literature, see pi[51l20j . 

5.2. Control Needle Variation. Similar to the control needle variation in- 
troduced in the proof of the Hybrid Maximum Principle in |26| . we introduce the 
following control needle variation for a left invariant control system. 



(5.18) u^{t, e) := u^{e,ui)it, e) 



Ml t^ - €<t<t^ 

u°{t) elsewhere 



where ui G U . Let us denote the state flow of the left invariant control system 
g{t) — f{g, u) as g{t) = g{t, s, go) where s is the initial time and go is the initial state. 
Due to the needle variation, the perturbed control system is given by 

(5.19) 5(7r,.)(0 = /(3(^,e)(i),"7r(i)), t&[tQ,tf]. 

Associated to u^r{■^ ■) we have the corresponding state trajectory g-n{.^ .) on G. It may 
be shown under suitable hypotheses, lim^^QgT,{t^e) = g{t) uniformly for to < t < tf, 
see [16] and [20]. Following (|5.19p . the flow resulting from the perturbed control is 
defined as: 

gtf\.) : [0,r] ^ G, g G G,t,s e [to,M,T G IR+, ^(e) G G, 

where 5^*'^^'^(.) is the flow corresponding to the perturbed control 7i^(t, e), i.e. 

(7^*'^^'^(e) := g^jL^]{t,t){g{s)). The following theorem gives the state variation of a left 
invariant control system with respect to a control needle variation. 
Lemma 5.4. For a Lebesgue time t^ , the curve 

. Jo, r] G is differ entiable at e ~ and the corresponding tangent vector 

(5.20) ^ffi*'/^'^|.=o=Ti,(4i)(/(e,ui)-/(e,u°(ti))), se[to,t'). 
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Proof. The proof is based on the left invariance property of /. As shown by 
Lcmma l2.8l the state variation with respect to the eontrol needle variation is given by 



(5.21) /(.g(ti), u^) - f{g[t^),u°{t')) = TLg^^i) (/(e, u,) - f{e, u"{t'))) , 

which completes the proof. □ 

The following lemma gives the state variation at an arbitrary time t, where < t, 
for a non-hybrid left invariant eontrol system. 

Lemma 5.5. Let gi^^^^){t) : [to,^/] G be a solution ofg!^^^^){t) = /(5(;r,e)(i), "7r(t)) 
then for t^ < t < tf 

■^gUj ^'^|e=0 = ri?e^p((t_tl)/(e,„o)) O TLg(4l) (/(e, Ui) - f{e,U°{t^)) e Tg(t)G', 

(5.22) 

w/iere Ti?g3,p((j_ti)j(g „o)) is the push forward of the right translation R^^p(^(^f_fi-^f(^^^^o^^ 
atg{t^). 

Proof. As shown in [5] for a given control system on a differentiable manifold Ai, 
the state variation at time t where t^ <t \s given as follows: 

(5.23) )^-|,^o = T<^f''\[f{x{t^),u^) - f{x{t^),u%t'))]) e T,(,)X, 

where is the flow initiating at x and corresponds to the control "U-JY ^ see 10 1 • 

The push-forward of $^*'* i.e. T$^*'* is computed along the nominal control 
u°{.) and is evaluated at x{t^). For a left invariant control system evolving on G, 
based on Definition 16.41 and Theorem 13. 4lwe have 



(5.24) 5(^,e)(t) = go o exp{tf{e,UT,)) = go o exp({t^)f{e,UT,) + {t - t^)f{e,u^)). 

Since u^(t) — u"{t), t G [t'^,tf], by the one parameter subgroup property of exp 
(see [32]) we have 

(5.25) g(,,,)(t) =5(,,,)(ti)oea;p((t-ti)/(e,?/°)),ti <t <t/. 
Therefore, by evaluating the push forward of composition maps, we have 

(5-26) -^gl" ^'""1^=0 = Ti?e^p((t„ti)y(e,„„)) x (^5^*y"^'^|,=o), s G [to,t^), 

which together with Lemma [5.41 and (|5.2ip yields the statement. □ 

We analyze the HOCP with the cost defined in (|5.ip and (|5.2p by defining a 
differential form of the penalty function h(.) which is differentiable by the hypotheses. 
Let us denote 

dh 

(5.27) dh:=^e n{G), 

og 

where Vl{G) is the set of smooth one forms on G. Li order to use the methods 
introduced in [51[S1[2D], we prove the following lemma using the optimal control u°{.) 
and the associated final state g°{tf). We denote ts{e) as the associated switching time 
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corresponding to ^^^(t, e) which is assumed to be differentiable with respect to e for 
all u eU. 

Lemma 5.6. For a Hybrid Optimal Control Problem (HOCP) defined on a Lie 
group G, at the optimal final state of the trajectory g°(t) we have 

(5.28) {i;^\,^^{dh{g''{tf))),TL^^-.^^^^{vAtf))} > 0, V«.(</) e Kt,, 

where 

ts<t<tf uieu 

T'iff°(t)(/9i(e,iii) - /qi(e,u°(t))) ClTga(tj)G, te[ts,t/], 

(5.29) 

and 

^tf= U U ™«=^p((*/-*=)/<!i(e>"°)) ° 

ta<t<ts ui£U 

TRexp{{t,-t)fo{e,u'')) °TLgo(t)[fq^{e,Ui) - f gg {e , U° {t))) 
H ^U=0J Wea;p((t^-t,)/„(e,«°)) ° 

TV(t,)(/gi(e,u°(f.))-/,„(e,u°(f.))) 

(5.30) CTga^t^.jG, t&[to,ts), 

and 

(5.31) Ktf=Kl,\jKl. 



Proof. Based on the definition of pull backs (see [HIH]), we have 

(5.32) °i;'it,){dh{g''{tf))),vAtf)), 
and since by the definition Ig = T*Lg-i, then 

(5.33) (X;„i,^)(d/i(5°(t/))),Ti^„-.(,^)(iv(i/))) = {dh{g"{tf)),v,{tj)). 

As shown in [29], {dh{g°{tf)),VTr{tf)) > for all v.,r{tf) G ii^t^. The set /Ctj,, as con- 
structed above, contains all the possible final state variation oi g°{tf ) G G, therefore 
the statement follows. □ 

The following lemma gives the relation between G{g°{ts)){N , .) e '^gf(t )^ ^"^^ 
any tangent vector X G Tgo((j<5 C Tgo(j^)G. 

Lemma 5.7. Consider an autonomous HOCP consisting of two different regimes 
separated by ak dimensional embedded switching manifold S C G; then at the optimal 
switching state g°{ts) G S and switching time ts we have 

(5.34) {I-\^^^{^G{g°{tMN,■)),TL^^-^^^^^X) =0, VX e Tg.(t.)S. 
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Proof. The proof is same as the proof given in f29| since 

(5.35) (Z;„i,^)(G(5°(t.))(iV,.)),rL^„-i(,^)X) =G(5''(is))(iV,X) =0. 
□ 

Here we give the proof for the HMP theorem on G. For simphcity of notation we 
simply denote the optimal trajectory by g{t) £ G. 

Proof. Step 1 : All the analyses here are performed along the optimal state tra- 
jectory g°{.), however, for simplicity of notation the superscript o is omitted for the 
optimal state trajectory g°{.). First consider tg < t^, where the needle variation is 
applied at time t^. As shown in [29], we have 

(5.36) < {dh,v^{tf)), \fv„ £ Ktf, 

where dh G '^g(t;)^- mentioned before, the cotangent bundle of the Lie group is 
identified by G x £ therefore 

(5.37) X-^,^.^{dh)£C\ 
By employing (|5.36|) . we have 

(5.38) rL3(ti) (e, u^) - (e, u°{i^))). 
The flow of the left invariant system on G results in 

(5.39) g%tf) = Lg(t)exp{{tf -t)fq,{e,u)), t€[t,,tf), 

then by the vector space properties of C and one parameter subgroups property of 
exp we have 

(5.40) g{t) = Lg„(t^,)exp(-(t/ -t)^(e,w)), 
which by the definition of Xg given in (j4.6p finally gives 

(5.41) < {T*Lg(^tr) oT*Re^p(^i^tf-ti)fg^{e,u)){dh),fg,{e,ui) - fg,{e,u°{t^))). 
Therefore Vu G U 

{T*Lg^ti) oT*Re^p(^^tf-t^)f,^ie,u)){dh),fq,{e,u°{t^))) < 

{T*Lg(^tl) O T*i?ea:p((t^._ti)/,^ (e,u)) {dh),fq^ (e. Ml)), 

(5.42) 
and 

(5.43) r*ig(-jl) oT*i?e2;p((ty:-tl)/,j(e,«))(c^/l) G C*. 

The adjoint variable is then defined by 

(5.44) A(t) = T*Lg^t)oT*R,,p(^(^tf^t)f,,ie,u)){dh) G C*,U <t<tf. 

Step 2: Second consider tg < t^ < t^ where t^ is the needle variation time. For a 
given switching time tg, the differential form of the normal vector is then given by 
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G{g{ts)){N, .) e T*^^ ^G. Here we have two possibilities, (i): tg < ts(e) and (m): 
ts{e) < tg. The corresponding control needle variations for these two possibilities are 
given as follows: 

(u°{t) t<t^-e 
ukt) l<ltl^^ ' 



Wits) ts<t< t,{e) 



and 



u°(t) t<t^~e 

u%t,) tsie)<t<U 

Notice that u°{ts) in (z) corresponds to fq„ under the optimal control and in (ii) 
corresponds to fq-^ under the optimal control. Following Lemmas 4.2 and 4.3 in [29] . 

in the case ts{e) < t,, ~ t°, we have 

|e=o = (^|.=o)rL,(,^,)(/.o(e,-°(i.))) + 

(5.45) ri?e:j,p(t^_tl)/^^(e,„o) orLg(tl)(/,„(e,M) - fqg{e,U°{f })) C Tg(t^)G. 

And for the case in which tg < ts{e) we have 

, (t.(e),ti),5(ti)) 

+T^e:rp(t,-ti)/,„(e,u°) ° ^£3(^1) (e, u) - fq„{e,u''{t^))) C ^^(f^jG. 

(5.46) 

The differentiability of ts{-) with respect to e is established in [33], Lemma 4.2. Equa- 
tion (|5.34p together with Lemma 15.51 implies 

^|.=o = -(i;(L)(G(.9(ts))(A^,.)),/,o(e,«°(t.)))-^ 

+ (r*L,(4i) o r*i?,,p((4^_4i)/(,,„)) (G(,9(i,))(7V, .)) , /,„ (e, u,) - 4, (e, u°if))), 
(5.47) 

Since : [0,e] ^ S and ^^i2o_ g t^^^^^^ c r<,(i^)G. In the 

second case 

^|e=o = (X-J^)(G(g(i.))(iV,.)),/,„(e,u°(t.)))-i x 

(T*Lg(ti) or*Eea;p((t= (G(ff(is))(iV,.)), /go (e,wi) - /9o(e,w°(t^))). 
(5.48) 

In order to obtain the state variation at ts, in case (ii), we use the push- forward of 
the combination of the flows before and after tg as follows: 

^'^'fll ^^Jqp I _ rpn 

\e=0 - J -«exp(t,-ti)/,o(e,M°) 
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(5.49) +^|,^orL,(,^)(/,„(e,«°(ti))~^(e,u°(ti))) Gr,(,,)G, 
and for case (i) 



■ei:p(ts-ti)/,j,(e,M°) 



orL,(,i)(/,„(e,^i) - /,„(e,^°(ii))) + ^|.=o 
(5.50) xTLg(,^)(/,,(e,u°(ti))-/,„(e,7.''(ti))) eT<,(,,)G, 

where the differentiabihty of ts{e) with respect to e for hybrid systems on Riemannian 
manifolds is estabhshed in }29j . The final state variation at the final time tj is now 
given as follows: 

U=0 ~ J ^exp(t J- -t,)/,i (£,«") X |e=0. 

Therefore 

X |,^orL,(,,) (e, «°(t.)) - (e, «°(t,))) 

(5.52) +TRexp(t,-t^)f,„(e,u'') °TLg^tl){fq„{e,Ui) - fqo(e,u°{f)))]) , 

Hence 

< {dhigitf}), 

X [ - (G(5(t.))(iV, .)) , A„(e, u^itsW 

X (r*Lg(fi) o T*i?e^p((t^_ti)/(e,„)) (^G(.g(ts))(A^, .)^ , 

/,„(e,ui)-/,„(e,u°(ti))) 
xri3(t.)(/,,(e,^/°(t.))-/,o(e,^°(t.))) 

(5.53) +ri?e^p(t^„ti)/^^(e,„o) oTig(ti)(/,„(e,wi) - /go (e, w°(i^)))] ) , 

equivalcntly 

< -(J-(,\)(G(.9(t,))(iV,.)),/,„(e,u°(i,)))-i 

X (T*Lg(fl) O r*i?e^p((t^_(l)/(e_„)) (^G(g(is))(A^, .)j , 

/,„(e,wi)-/,,(e,7.°(ii))) 

X {dh{g°{tf)),TR^^p^tf-t,)fg^ (e.w) ° TLg^^t,) 

(/,,(e,7.°(i,))-/,„(e,u°(i.)))) 

+ {dh{g(tf)), TRexp(^tj-t,)f^^ (e,ti°) 

(5.54) oTi?e2^p(t^_ti)/ (e^„o) oTLgi^ti){jq„{e,ui) - /,o(e,ii°(t^)))) < 0, 
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Let US denote /i by 

^, = -{i;^l^{GigitMN, .)) , /,o(e, Wit,)))-' 

(5.55) {dh{g°{tf)),TR^^p^ti-t,)f^^{e,u'')TLg(t,){fqAe,u°{ts)) - /^^(e, w°(t^)))), 
therefore 

< {dh{g{tf)),TRe^p(^ti-t,)fg^{e,u'>) ° 7'-Rea;p(t,-ti)/,o(e,«°) °TLg(^t^) 

(/9o(e,tii) - fqo{e,u°{t'))))+^i{T*Lgi^ti) 

(5.56) oT*i?,,p((t^_ti)/(e,„))(G(g(<3))(7V,.))),/,„(e,ui) -/,„(e,«°(ti))) < 0. 

Similar to step 1 we have 

{dh{g{tf)),TRexp(tf-t,)fg^{e,u'') ° ri?e2:p(t,-ti)/,^(e,u°) O TLgi^t^) 
{fqoie,Ul) - fgoie,u''(f )))) = (T*Lg(tl) oT*i?e:rp(t,_ti)/,g(e,u°) 

(5.57) oT*Re^p(^tf-t,)f,^{e,w){dh{g{tf))), (/,„(e,ui) - /q„(e,M°(t^)))), 
Combining (|5.56p and (|5.57p we have 

< (T*Lg(ti) o r*i?g^,p(t^_ti)j._^^(g „o) o r*i?g^p(t^_j^)j_^jg_„„)(d/i(sr(i/))), 
(/,o(e,«i) - /,„(e,^i°(^l)))) +M(r*Lg(,i) 
[GigitMN,.)) 

(5.58) 

The adjoint process A is defined as follows: 

X{t) = T*Lgi^t) °T* Rexp{t,-t)fg^{e,u'>) °T*R^^p(tf-t,)fg^(e,u'>){dh{g{tj))) 

+fiT*Lg(^t) o T*R^^p((^t,-t)f(e,u)) (G{g(ts)){N, .)^ . 
(5.59) 

At time t = we have 

(5.60) A(t;) = \{U) + /iT*L<,(,^)(G(g(f,))(iV, .)) S £* . 
ft only remains to show 

(5.61) ^ = rL,(,)(^), ^ = -(ad)i^(A(t)),te[f„i,+i),'?. eg. 

The first part of (|5.6ip is obvious by the definition oi Hq. := {X,TLg-ii^i-jfq.{g{t),u)), 
since fq. is left invariant and ^ = TLgj^f-^ o TLg-ij^i-^fq.{g{t),u) = fq-{g{t),u). For a 
given g & G we define the conjugate map Ig : G G as follows (see [TlfT^): 

(5.62) Igih) = g*h*g-\ 
The adjoint map Adg : C C is defined by 

(5.63) Adg = Tig = TLg o TRg-l , 
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where the dual of the adjoint map Ad* is calculated as Ad* = T*Lg o T*Rg-i. As 
is obtained in step 1, \{t) = —T*Lg(^f^ o r*i?g2.p((t^_j-)j(g G C* , then in order 

to establish the second claim of (|5.61l) . it is enough to show that A(t) = ^(i*^-^^ (A(0)) 
where without loss of generality we set = and A(0) = X{ts)- Therefore we need 
to show 

^*-^9(t) °T* Rexp{{tj-t)f(e,u)){dh) = 

'^*^ait) ° ^*^S"Ht) ° ^*-^9(0) ° T* Rexp((tf)f{e,u)){dh). 

(5.64) 

Employing the group operation we have 

(5.65) g[t}) = 5(0) * exp(t//,, (e, u°)) - 5(0) * g[t) * g-\t) * exp(t//,, (e, u°)), 
and also 

(5.66) g{tf) = git) * expHtj - t)fg, (e, u")), 
then 

Rexp{{tj-t)f,^(,e,u'')){g{t)) = ^ea;p(ty/,j(e,«°)) ° ^9(0) ° ^g- 1 (*) ) > ^9{t) ^ G, 

(5.67) 

which implies 

(5.68) T* Rexp{{tf-t)f,^{e,u'')) = T*Rg-i(t) °T*Lg(^Q) ° T* RexpUff^^icw)), 
which shows (|5.64[) . As shown in [18|, A(<) = Ad*^^-^{X{0)) implies 

(5.69) ^ = -((ad)*|)A(i) = -((ad)*^)A(t), 

and this completes the proof. The analogous argument holds for A(t), tQ < t < t,. 
□ 

5.3. Interior Optimal Switching States. Here we specify a hypothesis for 
MHOCP which expresses the HMP statement based on a differential form of the hy- 
brid value function. 

A4' For an MHOCP, the value function v{g,t), g G G,t G {to,tf), is assumed 
to be differentiable at the optimal switching state g°{t~) in the switching manifold 
iS, where the optimal switching state is an interior point of the attainable switching 
states on the switching manifold. 

We note that A4 rules out MHOCPs derived from BHOCPs (see Lemma Ej]). The 
following theorem gives the HMP statement for an accessible MHOCP satisfying A4^ . 

Theorem 5.8. Consider a hybrid system satisfying the hypotheses presented in 
AI-A4 on a Lie group G and an embedded switching submanifold S C G. Then 
corresponding to the optimal control and optimal state trajectory u°{t),g"{t), there 
exists a nontrivial A° G C* along the optimal state trajectory such that: 



(5.70)i/,,(.g°(t),A°(t),ii°(t)) <i/,,(.g°(t),A°(t),ui),Viii G U,t e [to, tf],i = 0,1, 
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and at the optimal switching state and switching time g°{ts),tg we have 

(5.71) A°(t;) = X''{ts)+fiT*Lg^t^^{dv{g:,ts)) £ C*. 
and the continuity of the Hamiltonian is given as follows 

(5.72) 7J,„(g°(t;),A°(t;),u°(t;)) = if,,(g°(t,),A°(t,),7.°(t,)). 
The adjoint variable A satisfies 

(5.73) ^ =TeL,(4)(^), ^ = -(ad)*o^(A(i)),t e [t„t,+i),g, gQ, 
where 

(5.74) Hg^{9,X,u) := (A, Ti^-i (.9, 
and 

(5.75) dv{g''{t;),t,) = ^^^^^ £ r;(,-)G. 

Proof. The proof is a repetition of the proof of Theorem 15.31 where G{g){N,.) 
is replaced by dv{g,t), where G is the Riemannian metric associated with the inner 
product I, see Lemma l5.1l As shown in Theorem l5.31 the adjoint process discontinuity 
is given by 

(5.76) A°(t;) = X''{t,)+^iT*Lg^t^^dvigits),t,). 
□ 

6. Exp-Gradient HMP Algorithm. In this section we introduce an algorithm 
which is based upon the HMP algorithm first introduced in |26| and then extended on 
Riemannian manifolds in j28j . The algorithm presented in j28| is an extension of the 
Steepest decent algorithm along the geodesies on Riemannian manifolds. As known 
(see |17j). geodesies are defined as length minimizing curves on Riemannian manifolds. 
The solution of the Euler-Lagrange variational problem associated with the length 
minimizing problem shows that all the geodesies on A4 connecting 7(a), 7(6) G A4 
must satisfy the following system of ordinary differential equations: 

n 

(6.1) Xi{s) + ^ r'^^f.Xj{s)xk{s) =0, i = l,...,n, 

j-k=l 



where 



(6.2) 



'^j.k- 2^ ^ ^^^'i 9jk,i)^ 9ji,k - Q 9ji : 
(=1 



where is the Riemannain metric corresponding to A4 and all the indices i,j,k 
here run from 1 up to n = dim( Ai) and [g^^] = [gif]^^- 
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In order to introduce the gradient of the value function on a Lie group G we 
employ the notion of inner product on a finite dimensional Lie algebra C defined in 
Section [5. II For a given value function u : G — )■ H on a Lie group G we have 

dv 

(6.3) dv\g := — G T;G. 
The gradient of u, i.e. Vw, is defined by 

(6.4) {dV,Xg)^G{g){VV,Xg), VXg^TgG, 

which can be written as 

{dv,Xg)={dv,TLgX) = {T*Lgdv,X) 

^I{TLg-lVV,TLg-lXg), VXg€TgG. 

(6.5) 

We call TLg-iVv the projected gradient of v on C. Similar to the geodesic gradient 
flow defined on Riemannian manifold A4 in |28| . we introduce Exp- Gradient Flow on 
Lie groups as follows: 

Definition 6.1. (Exp-Gradient Flow) Let 0° = 0, and g{9^) ~ g" G G, then for 
all < k and all g^ such that TL ^^-'^'^^{g^) ^ 0, define 

(6.6) 7<,^(e) - .g'X^) :=/*exp(-(?Ti^,-iVz;(/)), ee[e\e''+^), g{e) € G, 
where 

(6.7) =/(^''+'), ^'+' =sup{s;^^^^^ <0,tG [0^s),sG [0^0" + l)}. 

s dt 



Over the interval of existence [0,uj) we denote the total flow induced by (|6.6p ) as 

(6.8) (^(0,5") =n^UV.(^''-\^^\5'~')°V'n(0",e,ff"), 

where 

U9^-\e\g^-') = jg.-.{9^~e^-'), 

(6.9) jgoiO' ~9")=jgo{9'),e" ^0, 

01 — 6/'-i is the elapsed time between the switching times 6'*, 6**^^ to the next iteration 
and n is the index number of the last switching before the instant 9. By the continuity 
of geodesic flows {tjji, 1 < i < oo}, ip is a continuous map on [0, w). In the notation 
of topological dynamics, and in particular LaSalle Theory (see e.g. [T3l[25] ). the limit 
set of the initial state is denoted as r2(.g*'), where 

y G n{g°) ^ 39n, n>l, s.t. lim g{9n) = y, 

(6.10) 

when lim„_i.oo(^'n) = i^. Note the sequence {0„} is in general distinct from {9^}. 

HI : There exists < 6 < oo such that the associated sublevel set Afb = {g G 
G; v{g) < b} is (i) open (ii) connected, (iii) contains a strict local minimum g^ which 
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is the only local minimum in Mb, (iv) A/j, has compact closure and (v) Mg^ C A/f,. 

Without loss of generality, we assume Ng, C A/h-e for some e > 0, then by 
selecting € Ng, C Mb-e C Mb we prove a; — oo by the following lemma: 

Lemma 6.2. For an initial state G Mg^, the existence interval of the flow 
defined in i [6'.^|) goes to oo. 

Proof. By HI we have Mg, C Mb-e- Choose < 9 < 9' then if 9 is not a 
switching time by the construction of (f>, i.e. (|6.7p 

(6.11) i;(^(0',g°)) <i;(^(0,5°)) <«(5") <^'-e<^- 

We need to prove the statement above when is a switching time. The derivative 
from the right of the flow (p which is the combination of the flows defined in (|6.6p at 
the switching state g'^ is given by 

— \0=o={dv, ~TLgkTLgk-i Vv) 

=-{T*Lgkdv, TL^k-i Vw) 
=-I{TLg,-i\/v,TLg,-iVv) < 0. 

(6.12) 

It follows by the construction of (p in 16. 8[ for all < < , that 

(6.13) v{ip{9' , gO)) < v{^{9, g")) < v{g°) < b - e < b, 
and hence for $+ := {ip{9,g")]0 < 9 < uj} 

(6.14) ¥+ C Mb-e C Mb. 



So the flow If is defined everywhere in Mb-e, where Mb has compact closure. Hence 
for all g S Mb-e we have an extension of ip in Mb, therefore the maximum interval of 
existence of (p{.,g^) in Mb is infinite. □ 

Theorem 6.3. Subject to the hypothesis HI on Mb and with an initial state g^ 
such that g*^ G Mb-e C M , < e < b, either the Geodesic- Gradient flow, ip, reaches 
an equilibrium after a finite number of switchings, or it satisfies 

(6.15) ip{9,g°)^n{g")cv-\c), c € R, 
as 9 ^ oo, for some c € R, where 

(6.16) Vyef7(g°), ^1,^0 = 0, 

d9 

and, furthermore, the switching sequence ~ {9^,9^, ' ' ' ,} converges to the limit 

point g^: G i^{g'^) C Mb, where g^, is the unique element of Mb such that '^1jv(g^,) = 0. 

Proof. The first statement of the theorem is immediate by the Definition 16.11 To 
prove the second statement, similar to the proof of the LaSalle Theorem, we proceed 
by showing that v{.) is constant on the set n{x'^). The precompactness of ( 
that is to say (i): C Mb, (ii): there does not exist 9i —^u!,i^ oo, such that 
ip{9i,g°) dMb, i.e. l+flSWb = 0), implies Vl{g^) ^ 0, see [B]. By the definition 
of r^(g") we have 



(6.17) VyGr!(.9°)^30„,n>l, s.t.,^(0„, 3°) y, ( 



00, 
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and since v{.) G , 

lim v{g{dn)) = lim v{(p{9n,g°)) = v{y) =: c. 

(6.18) 

Now choose y € y ^ V, then by the existence of a convergent sequence g{6^) 

to y we have 

Ve > ^ 3?!, m, k s.t. On < O'^^ < On+k 

c - e < v{g{en+k)) < vig{e',J) < v{g{en)) < c + e, 

(6.19) 

i.e. v{y ) = c, hence fl{x'^) C v~^{c). To prove stationarity, i.e. (|6.16p . we observe 
that n(a;°) is positive invariant under the flow (p, i.e. 

(6.20) ^(0,17(5°)) C 17(5°), 0>O. 

This follows from the continuity of ip{., .), see |13| . Differentiability from the right for 
all g e ip{9,g°),0 < 9, implies 

dv v{ip{e,y)) - v{ip{0,y)) 
-7^\0=o= hm 

= hm ^ = 0, ye 0(5"), 

f6.21) 



since ^{9,y) £ 0(.g") by (jOOl and v(r2(g°)) = c by (|09)) . 

It remains to prove the statement for the sequence of the switching states 
\^g^ ig^ , ■ ■ ■}. The switching sequence {g}o° consists of the switching points on ip{9,g'^) 
which by ()6.6p is an infinite sequence. 

The precompactness of with respect to Afb implies the existence of a convergent 
subsequence of {g}^ such that 

lim ip{9f, gO) = g* £ f](5°), n{g^) C ¥+ C MZ. 

(6.22) 

Since v 6 C°°(A/'&) 

(6.23) lim Vz;(¥>(0r,5")) = V«(g*), 

and 

But since the state Lp{9f,g'^)) is a switching state chosen from the switching sequence 
rfi;(y>(gr,g°)) , 

|8=o = -1(J -L^(ej.,gO)-iVi;, J gO)-i Vw), 

(6.25) 
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As is stated in (j6.22p . the limit point g* is an element of the limit set therefore 
by (|6.2ip we have 

(6.26) ^!^|,^o = 0. 

From we have 

= ,„ 1 9^0 = lim — e=o 

da i-i-oo dy 

= .lim ( - I{TL^(^gr, gOyiVv,TL^(^gr, gO-^-iVv)). 

(6.27) 
Hence 

(6.28) Vt;(.g*)=0, 
or equivalently 

(6.29) = 0. 

But by Hl,g^ is the unique point in A/f,_e C Afb for which this holds, hence all 
subsequences of {g}"^ converge to = g* an hence so does the sequence. □ 

Definition 6.4. (EG-HMP Algorithm) 
Consider the hybrid system h5.1\) with two distinct discrete states and the performance 
function v{.). 

• Set k — and initialize the algorithm with g^ = g{Q) G G. 

• For a given < /3, compute Vv{g'''). // /(TL^k-i Vw, TL^fc-i Vu) < /3, then 
stop, else 

lg.{6)^g{6)^g^*exp{-eTLg,-^Vv{g^)), 6 e[e\6^+^), g{0)eG, 
where 

gk+i ^ Qk+i = sup{s; < 0, t e s), s e [^?^ 0^ + 1)}. 

s Clt 

• Set k := k + 1 and go to the second step. 

Theorem 6.5. Assume HI holds for Mb C G and g^ G Mb, for the HOOP with 
the performance function v{.). Then there exists a single finite k at which the algo- 
rithm stops and either: 

(i): < I{TLg,-^Vv,TLg,-^Vv) < p. 



(a): I{TLgk-i^v,TLgk-i^v) = 0, in which case the Geodesic- Gradient flow, ip, 
reaches an equilibrium after a finite number of switchings and hence yv{g^^^\f3)) = 
and g^^^\j3) = g^,, where g^ is the unique point of Mb C G such that ||Vt'(5*)|| = 0. 

In either case, g^^^'^ (/3) is such that 
(6.30) g^^'^\P) 9*. k{P)^oo, as /3 ^ 0. 
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Proof. The first statement is immediate by the Definition 16.41 The second holds 
since v{.) has a unique local minimum at g^, and v{.) G C^{Mb) with Vu(.g*) = 0, 

(6.31) pfi{g,) : = su^ {dG{g,g.);l{TLg-.Vv,TLg-^Vv) < /?,.g G G}, 

where dci-,-) is the distance on G. Moreover p is such that pp{g*) — !■ as /3 — ?> 0, 
hence g^^^\fi) g*, as [3 ^ 0, see [21. □ 

7. Satellite Example. In this section we give a conceptual example for a satel- 
lite orientation control which is modeled by elements of 5*0(3). The control inputs 
in this model are given by the angular velocities in order to display the notion of left 
invariant hybrid systems optimal control. 

We recall that 50(3) is the rotation group in given by 

(7.1) SO{i) = {g e GL(3)| g.g^ = /, det{g) = l}, 

where GL{n) is the set of nonsingular nxn matrices. The Lie algebra of 5*0(3) which 
is denoted by so(3) is given by (see |32j ) 

(7.2) so{3) = {X e M{3)\ X + X'^ = 0}, 

where M{n) is the space of all n x n matrices. The Lie group operation * is given by the 
matrix multiplication and consequently TLg^ is also given by the matrix multiplication 

X€Tg,G. 

A left invariant dynamical system on 50(3) is given by 

(7.3) m=9X, g(0)=go, X e so(3). 

The Lie algebra bilinear operator is defined as the commuter of matrices, i.e. 

(7.4) [X,Y]=XY-YX, X,Yeso{3). 

The kinematic equations expressing the state trajectory g{.) for a satellite is given by 

(7.5) J 9{t) ~9{t)Mt) g{t)eSOi3),Xit)esoi3). 
\ X{t) +I-\X{t) xIX{t)) =I-W{t) ^' V ; w 

The first line of the equation above is written as 

/ g'li 912 913 \ I 911 912 513 \ / Xi{t) Xsit) 
(7-6) g2i 922 923 = 521 322 523 -Xi{t) X2it) 

\ 931 932 933 J \ .931 532 533 / \ -X^it) - X2(t) 

and ? : so(3) — ?► K? is an isomorphism such that 



Xi{t) Xsit) 
(7.7) ( -X^it) X^it) I =(Xi(t),X2(0,X3(i)). 

-Xsit) -X2{t) 



I is the inertia tensor given by 



Il 
I2 
I3 

X is the cross product in R'^. For more details of the modeling above see [H], page 



, the input torque is t — > r(i) G W' and 
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281. The second part of (j7.5p is the controlled Euler-Poincare equation and (|7.5p is 
the geodesic equation on G in the presence of external forces, see [SKI]- 

We simphfy the satchite model above in order to be able to give an explicit 
computational example of Theorem 15.31 In this example we consider X S so(3) as 
the control, i.e. X{t) = {ui{t),U2{t),u^{t)) G R"^. A controlled left invariant system 
on S0{?>) is then defined by 

ui{t) usit) \ 
(7.8) 5(t)=5(t)( -ui{t) U2it) , g{t) e SOi3),iui,U2,U3) eR^. 

-U3it) -U2(t) / 

I 1 \ / 

The Lie algebra so(3) is spanned by ei = (— 10 ,62= 1 | and 

00/ \0-10 

One can check that 




(7.9) [61,62] =63, [61,63] = -62, [62,63] =61. 

By the controllability results presented in [18] since all the Lie algebras generated 
by (61, 62), (62, 63), (61, 63) span the tangent space of the Lie group all the systems 
derived by each pair of controls are controllable. Here we define a hybrid system on 
SO{3) as follows: The continuous dynamics arc given by 

SO ui{t) \ 
-ui(t) U2it) ] ,te [to,t,) 
-U2{t) / 
ui{t) usit) \ 
-ui{t) \,te[t„tf] 
-U3{t) 0/ 
giit),g2{t) e50(3),(ui,M2,U3) GlR,3, 

where 

(7.11) Ji = ^ r ui{t)+ ui{t)dt, J2=\ r ui(t) + ui{t)dt. 

^ Jta ^ J to 

The Hamiltonians corresponding to the left invariant dynamics are 

(7.12) Hi{X,Ui,U2) = (A,Mi6l +lt262) + -{uf + U^) , 

(7.13) H2{\,ui,U3) = (A,uiei + U363) + ^{uf + ul), 

where A = Ai6^ + A262 + A363 and (e*,6j) = J^.j, i,j — 1,2,3. By the Minimum 
Principle, the optimal controls are obtained as 

(7.14) ul{t) = -Xi{t),u*2{t) = -\2{t),t e [to,t.), 

(7.15) ul{t) = -Ai(t),u*(t) = -A3(t),t 6 [t,,tf]. 
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Fig. 7.1. Hybrid State Trajectory (discrete state 1) 




200 400 600 800 1000 

Time Sample 

Fig. 7.2. Hybrid State Trajectory (discrete state 2) 



By (|7.9p we have 
(7.16) 







adei = I 



1 



(7.17) 



(7.18) 



ade 









1 











-1 











- 1 





1 
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Fig. 7.3. Hybrid Adjoint Trajectory (discrete state 1) 
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Fig. 7.4. Hybrid Adjoint Trajectory (discrete state 2) 



And 
(7.19) 

therefore 

(7.20) 



dH2 
dX 



uici + Uses, 



00u2\ /O-itsO 
ad oHi = 1 — ui , ad oH2 = U3 — ui 

-U2 Ul J ^ \ Ul 



Hence the differential equations corresponding to the adjoint variable A are given by 
(7.21) 



Xi{t) = X3{t)u*2{t), 
Ht) = ^X3{t)ul{t), 
Xsit) = -Xi{t)u*2{t) + X2{t)ul{t), te [to,t,), 
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Fig. 7.5. EX-HMP Convergence 



(7.22) A2(t) = Ai(iK(t)-A3(tK(t), 

Definition 7.1. For a finite dimensional Lie algebra so(3), we define the Killing 
Form B{., .) : so(3) x .so(3) R as 

(7.23) B{X, Y) = triadxady), X, F G so(3). 



The Killing Form is invariant in the sense that 

(7.24) B{[X,Y],Z)^B{X,[Y,Z]). 

Now corresponding to B wc introduce an inner product Is on so(3) such that 

(7.25) Ib{XX) = -triadxady). 

Lemma TS.ll implies that B induces a left invariant metric on G. By (|7.16p - (|7.18p we 
have 

(7.26) 

By the realization above, T*Lgdv = Xie^ + Xi^-'^ + Aseg G so*(3) implies that 
(7.27) TLg-.Vv = ^ei + + yeg £ so(3). 

/ 1 

The algorithm initiates from to = 0, = 10, go = —1 | , = 5.8s 

\ 1 

and ga ^ \ —\ I and = I 1 I . The algorithm converges to 






30 



Farzin Taringoo, Peter Caines 



/ 0.3039 0.9574 - 0.1194 \ 
gs = -0.3688 0.1508 - 0.9165 and = 5.9733. The state trajectory and 

\ -0.8604 0.3156 0.3988 / 
adjoint variables are shown in Figures 17.1117.41 and Figure 17.51 shows the convergence 
of the Exp-HMP algorithm. 
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